In Real Application Cluster (RAC), one of Oracle’s high availability solutions, all nodes are active, applications or users can work by connecting to any of them. This technology is only available in Oracle. With the services, the node that applications/users will connect to can be determined by the rules. In case of a problem with the connected node, they can continue their work by connecting to one of the other nodes. There will be no service interruption. It is a structure that we recommend for critical places.
This article tries to explain the RAC setup in an easy step-by-step process.
The setup of Oracle RAC has the below major sections:
1. Network setting information
2. Setup of OpenFiler(SAN)
3. Setup of Oracle Linux server
4. Setup of Node1
5. Setup of Node2
6. Setup of Grid Infrastructure
7. Testing and Troubleshooting
Applications to be used during setup
Oracle
http://www.oracle.com/technetwork/database/enterprise-edition/downloads/112010-linx8664soft-100572.html
linux.x64_11gR2_database
linux.x64_11gR2_grid
On Linux operating systems (distros)
https://edelivery.oracle.com/EPD/Search/handle_go
Along with the operating system, the version of oracle that is running should be certified by Oracle
https://metalink.oracle.com (requires registering a user ID & password, on behalf of your organization) -> can be found in the Certifications category/tab
This isn’t a requirement if the operating system being used isn’t certified. However, using a system that hasn’t been certified can result in continuity problems as well as ineligibility for official Oracle support. In a production enironment this is highly discouraged !!
A Turkish bank had made this mistake at one point, resulting in serious problems.
SAN (open filer)
http://www.openfiler.com/community/download/
Network Settings
NAS
NIC-1 -> custom-vmnet1 (hostonly)
NIC-2 -> bridge
RAC1
NIC-1 -> custom-vmnet1 (hostonly)
NIC-2 -> bridge
RAC2
NIC-1 -> custom-vmnet1 (hostonly)
NIC-2 -> bridge
NAS
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 |
[root@nas ~] $ ifconfigeth0 Link encap:Ethernet HWaddr 00:0C:29:6C:7F:AE inet addr:10.0.0.10 Bcast:10.0.0.255 Mask:255.255.255.0 inet6 addr: fe80::20c:29ff:fe6c:7fae/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:24594 errors:0 dropped:0 overruns:0 frame:0 TX packets:36880 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:5044034 (4.8 MiB) TX bytes:49076445 (46.8 MiB) eth1 Link encap:Ethernet HWaddr 00:0C:29:6C:7F:B8 inet addr:192.168.137.101 Bcast:192.168.137.255 Mask:255.255.255.0 inet6 addr: fe80::20c:29ff:fe6c:7fb8/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:84 errors:0 dropped:0 overruns:0 frame:0 TX packets:14 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:7608 (7.4 KiB) TX bytes:843 (843.0 b) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:8 errors:0 dropped:0 overruns:0 frame:0 TX packets:8 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:560 (560.0 b) TX bytes:560 (560.0 b) |
RAC Node1 (Before setting up Oracle)
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 |
[root@rac1 ~] $ ifconfig eth0 Link encap:Ethernet HWaddr 00:0C:29:CB:1B:0F inet addr:10.0.0.20 Bcast:10.0.0.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:92903 errors:0 dropped:0 overruns:0 frame:0 TX packets:71071 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:111026826 (105.8 MiB) TX bytes:23477544 (22.3 MiB) eth1 Link encap:Ethernet HWaddr 00:0C:29:CB:1B:19 inet addr:192.168.137.20 Bcast:192.168.137.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:278 errors:0 dropped:0 overruns:0 frame:0 TX packets:282 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:57151 (55.8 KiB) TX bytes:57122 (55.7 KiB) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:27765 errors:0 dropped:0 overruns:0 frame:0 TX packets:27765 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:9532941 (9.0 MiB) TX bytes:9532941 (9.0 MiB) |
RAC Node1 (After setting up Oracle)
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 |
eth0 Link encap:Ethernet HWaddr 00:0C:29:CB:1B:0Finet addr:10.0.0.20 Bcast:10.0.0.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:92903 errors:0 dropped:0 overruns:0 frame:0 TX packets:71071 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:111026826 (105.8 MiB) TX bytes:23477544 (22.3 MiB) eth1 Link encap:Ethernet HWaddr 00:0C:29:CB:1B:19 inet addr:192.168.137.20 Bcast:192.168.137.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:278 errors:0 dropped:0 overruns:0 frame:0 TX packets:282 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:57151 (55.8 KiB) TX bytes:57122 (55.7 KiB) eth1:2 Link encap:Ethernet HWaddr 00:0C:29:CB:1B:19 inet addr:192.168.137.52 Bcast:192.168.137.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 eth1:3 Link encap:Ethernet HWaddr 00:0C:29:CB:1B:19 inet addr:192.168.137.50 Bcast:192.168.137.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 eth1:4 Link encap:Ethernet HWaddr 00:0C:29:CB:1B:19 inet addr:192.168.137.40 Bcast:192.168.137.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:27765 errors:0 dropped:0 overruns:0 frame:0 TX packets:27765 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:9532941 (9.0 MiB) TX bytes:9532941 (9.0 MiB) |
RAC2 (Before setting up Oracle)
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 |
[root@rac2 ~] $ ifconfigeth0 Link encap:Ethernet HWaddr 00:0C:29:FA:26:13 inet addr:10.0.0.21 Bcast:10.0.0.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:137807 errors:0 dropped:0 overruns:0 frame:0 TX packets:113477 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:149604744 (142.6 MiB) TX bytes:33850337 (32.2 MiB) eth1 Link encap:Ethernet HWaddr 00:0C:29:FA:26:1D inet addr:192.168.137.21 Bcast:192.168.137.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:569 errors:0 dropped:0 overruns:0 frame:0 TX packets:619 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:133589 (130.4 KiB) TX bytes:135330 (132.1 KiB) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:18384 errors:0 dropped:0 overruns:0 frame:0 TX packets:18384 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:9657346 (9.2 MiB) TX bytes:9657346 (9.2 MiB) |
RAC Node2 (After setting up Oracle)
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 |
[root@rac2 ~] $ ifconfigeth0 Link encap:Ethernet HWaddr 00:0C:29:FA:26:13 inet addr:10.0.0.21 Bcast:10.0.0.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:137807 errors:0 dropped:0 overruns:0 frame:0 TX packets:113477 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:149604744 (142.6 MiB) TX bytes:33850337 (32.2 MiB) eth1 Link encap:Ethernet HWaddr 00:0C:29:FA:26:1D inet addr:192.168.137.21 Bcast:192.168.137.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:569 errors:0 dropped:0 overruns:0 frame:0 TX packets:619 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:133589 (130.4 KiB) TX bytes:135330 (132.1 KiB) eth1:1 Link encap:Ethernet HWaddr 00:0C:29:FA:26:1D inet addr:192.168.137.41 Bcast:192.168.137.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 eth1:2 Link encap:Ethernet HWaddr 00:0C:29:FA:26:1D inet addr:192.168.137.51 Bcast:192.168.137.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:18384 errors:0 dropped:0 overruns:0 frame:0 TX packets:18384 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:9657346 (9.2 MiB) TX bytes:9657346 (9.2 MiB) |
Using RMAN for...
12 March 2019