Automated Build / Rebuild (Customer) Instructions

About

This document provides customer instructions for building / rebuilding a PAS or DNC, which can then be incorporated into a new or existing cluster or can be used to replace a lost node. It will NOT restore any lost data.

Prerequisites / Assumptions

• Customer has obtained or created on boot media (USB, DVD, etc.) with the required NMS recovery installation files. NOTE: For further details, see the appendix on boot media.

• Customer must have physical access to the console of the target SevOne PAS hardware and a minimum USB stick size of 32GB.

• Customer knows the required network settings to be installed:

  • Hostname

  • The network interface which should be used (e.g. eth0)

  • IP Address, in dotted decimal notation (e.g. 10.10.10.30)

  • Netmask, in dotted decimal notation (e.g. 255.255.255.0)

  • Broadcast address, in dotted decimal notation (e.g. 10.10.10.255)

  • Default Gateway, in dotted decimal notation (e.g. 10.10.10.1)

• Customer knows the submodel capacity of the NMS installation. (e.g. 100K.)

Installation using ISO

NOTE: Depending on your NMS version, the specific options and numbering may vary from the screen shots below.

1. Insert boot media (or verify that SD card is present) with recovery installation files. Please refer to section Appendix - Obtain/Create Boot Media for boot media details.

2. Reset power on the server.

3. When the option appears, press F11 to enter Boot Manager.
   

   

   
   
   

4. In Boot Manager Main Menu, select One-shot BIOS Boot Menu.
   

   

   
   
   

5. In Boot Menu, find and select the boot media (USB, DVD or SD card).
   

   

   
   
   

6. Select the appropriate NMS platform type for this model.
   

   for FULL build / rebuild,

   If you select a NMS model from the list below i.e., PAS10k or PAS20k, etc., you will build a new appliance. Everything existing on the selected appliance at present, will be wiped out. Please proceed with CAUTION!

   

   In this example, Install RHEL NMS PAS60k is selected. By choosing a NMS model, your selected appliance, i.e., PAS60k, will be completely wiped out and SevOne will start the installation.

   for PARTIAL build / rebuild,

   If you want to perform a partial build, i.e., build a new appliance and preserve your /data folder, then select the Support option in the screenshot below followed by the <RETURN> key. Enter the default password, supportuser .

   

   You will have an option to rebuild the PAS or DNC appliance.

   

   Based on the option (PAS or DNC) chosen, it will rebuild your selected appliance while preserving the /data folder.

   Let's choose PAS Rebuild preserving /data.

   
   In the screenshot above, PAS60k Rebuild preserving /data is selected. Click the <RETURN> key to rebuild SevOne RHEL NMS PAS60k. This option will mount data Read Only at /data_ro and erase the root disk.

   To re-mount /data_ro partition to its original location, /data, using a text editor of your choice, modify /etc/fstab file properly. By doing this, the data for the selected PAS or DNC prior to the rebuild, will be restored. For assistance with this, please contact SevOne Support.

   If you choose Troubleshooting followed by the <RETURN> key, you will have the following options.

   

   • Rescue a RHEL system - if your system does not reboot, it will allow you to access and edit your configuration files to try to get the system to boot again.

   • Run a memory test - if you system is having issues, a problem with your system memory may be the cause. Use this utility to check if the memory is working correctly.

   • Boot from local drive - allows you to boot from the local drive.

7. On successful completion, you will see the SevOne version screen, showing the IP address of your appliance.
   

   The "SevOne NMS Version … Configuration Menu" enables you to enter your company's network settings onto the appliance. You need the following information:

   • System Name (Host Name)

   • Host IP address and sub-netmask

   • Broadcast address

   • Default Gateway IP address

   • DNS primary & secondary IP address

   • NTP (Time Server) IP address

   • SNMP Settings

   • Domain Name

   
   

   

   
   

   On the first page, press Enter to display the logon page that controls access to the Configuration Menu.

   

8. Enter the default password, supportuser.

   When you log in here for the first time, you are logging as the user support. Steps for changing the default password for the support user are in the OS-level User Names and Passwords section. It is important that you change the default password.

   Failure to change the default password presents a significant security risk.

   Press Enter to display the system configuration menu.

   
   

9. System Name in the left menu is selected.
   

   

   
   
   

10. Press Enter to display the System Name fields on the right.
    

    

    
    

    1. In the Hostname field, enter the hostname for the SevOne NMS appliance.

    2. Press Enter to save the System Name settings and return the focus to the menu on the left.
       
       

11. Press the down arrow to select IP Address and Gateway and press Enter to display the IP address and gateway fields on the right .
    

    

    
    

    If your network uses DHCP, type Y to disable the following fields and skip the IP Address and Gateway steps. If your network does not use DHCP, type N and complete the following fields.

    1. In the IP Address field, enter IP address of the SevOne NMS appliance and press Tab.

    2. In the Netmask field, enter the netmask of the SevOne NMS appliance and press Tab.

    3. In the Gateway field, enter the IP address of the SevOne NMS appliance and press Tab.

    4. In the Broadcast field, enter the SevOne NMS broadcast IP address.

    5. Press Enter to save the IP Address and Gateway settings and return the focus to the menu on the left.
       
       

12. Press the down arrow to select DNS and Search Domains and press Enter to display the DNS and Search Domains fields on the right.
    

    

    
    

    1. In the Primary DNS field, enter the IP address of the DNS server for SevOne NMS to use first and press Tab.

    2. In the Secondary DNS field, enter the IP address for SevOne NMS to use second, if applicable and press Tab.

    3. In the Tertiary DNS field, enter the IP address of the DNS server for SevOne NMS to use third, if applicable and press Tab.

    4. In the Search Domains field, enter the domain names or IP addresses for the search domains for SevOne NMS to use (separated by a space).

    5. Press Enter to save the DNS and Search Domains settings and return the focus to the menu on the left.
       
       

13. Press the down arrow to select Time and Date and press Enter to display the Time and Date fields on the right .
    

    

    
    

    1. Confirm that the time and date are correct for Greenwich Mean Time (GMT) (a.k.a. Coordinated Universal Time (UTC)). This is the SevOne NMS system time. You define time and date settings for users, devices, and reports via the SevOne NMS GUI in a later step.

    2. If needed, enter the time and date using the appropriate format in the fields provided.

    3. Press Enter to save the Time and Date settings and to return the focus to the menu on the left.
       
       

14. Press the down arrow to select NTP Servers and press Enter to display the NTP Servers fields on the right.
    

    

    
    If your network uses DHCP, type Y to disable the following fields and skip the IP Address and Gateway steps. If your network does not use DHCP, type N and complete the following fields.
    

    1. In the Servers field, enter the DNS name or IP address of the time server for SevOne NMS to use to maintain time settings.

    2. Press Enter to save the NTP Servers settings and to return the focus to the menu on the left.
       
       

15. Press the down arrow to select SNMP Settings and press Enter to display the SNMP Settings fields on the right.
    

    

    
    

    1. In the Read Only Community field, enter the SNMP read community string for other devices to use to poll SNMP data on this appliance when communicating via IPv4 and press Tab.

    2. In the Read Only Community (IPv6) field, enter the SNMP read community string for other devices to use to poll SNMP data on this appliance when communicating via IPv6 and press Tab.

    3. In the Trap Destination field, enter the IP address or hostname of the destination where traps this appliance generates are to be sent and press Tab.

    4. In the sysContact.0 field, enter the text you get when you SNMP walk the sysContact OID and press Tab.

    5. In the sysLocation.0 field, enter the text you get when you SNMP walk the sysLocation OID and press Tab.

    6. In the sysName.0 field, enter the text you get when you SNMP walk the sysName OID.

    7. Press Enter to save the SNMP Servers settings and to return the focus to the menu on the left.
       
       

16. If you changed the System Name settings or the IP Address and Gateway settings, press the down arrow to select Shutdown and Restart and press Enter to display a Shutdown option and a Reboot option on the right.

    For all other configuration setting changes, you can press the down arrow to select Exit.

    

    In the Shutdown/Restart section select an option and press Enter to shut down or reboot the SevOne NMS appliance.

    If you select Exit, when you press Enter, the changes will be save and some services may restart and the initial Configuration Menu Welcome page appears.

    You can now disconnect the monitor and keyboard.
    
    

17. In the configshell, you will see a URL. From another computer, please verify that you are able to access this URL. Also, the IP Address should match.
    

    Firewall rules should be applied prior to testing this step.

Installation from ISO using iDRAC

1. The latest ISO file can be downloaded from IBM Passport Advantage ( https://www.ibm.com/software/passportadvantage/pao_download_software.html ) via Passport Advantage Online . However, if you are on a legacy / flexible SevOne contract and do not have access to IBM Passport Advantage but have an active Support contract, please contact SevOne Support Team for the file.

2. Logon to iDRAC.

3. Click the window for the virtual console on the lower-right corner to open the virtual console.

4. Click Virtual Media button.

5. Click Connect Virtual Media button.

6. Under Map CD/DVD, click Choose File button and select the ISO file obtained from IBM Passport Advantage via Passport Advantage Online or SevOne Support Team.

7. Click Map Device button.

8. Click Close button.

9. Click Boot button and select Virtual CD/DVD/ISO.

10. Click Yes button.

11. Click Power button and then, click Power On System or Power Cycle System (cold boot) if the system was already on, click the Yes button if prompted.

12. Select the product and version to install from the boot menu and allow installation to complete.
    
    
    

    To view the list of DNC, click Install RHEL NMS DNC.

    

OS-level User Names and Passwords

You will need to change the default passwords for the admin, root, and support user accounts. This is important for security reasons.

Failure to change the default passwords presents a significant security risk. This publication includes default passwords and this document has probably been made available to the public.

Enable Firewall

On appliances that are running RHEL, the firewall will be disabled. This applies to both appliances with new SevOne NMS installs and appliances that were previously running CentOS, then moved to RHEL. Perform the following steps to enable the firewall.

1. SSH into the appliance as root.

2. Execute the following command to enable firewalld.

   $ /usr/bin/systemctl enable firewalld

3. Execute the following command to start firewalld.

   $ /usr/bin/systemctl start firewalld

4. Execute the following command to identify custom ports.

   $ netstat -tuplet

    

   Active Internet connections (only servers)

   Proto Recv-Q Send-Q Local Address Foreign Address State User Inode PID/Program name

   tcp 0 0 0.0.0.0:ssh 0.0.0.0:* LISTEN root 515537 70512/sshd

   tcp 0 0 localhost:mmcc 0.0.0.0:* LISTEN root 982646 206874/SevOne-maste

   tcp 0 0 0.0.0.0:https 0.0.0.0:* LISTEN root 909604 194384/nginx: maste

   tcp 0 0 localhost:pharos 0.0.0.0:* LISTEN root 903924 193160/messageswitc

   tcp 0 0 localhost:ita-agent 0.0.0.0:* LISTEN root 890957 189990/SevOne-datad

   tcp 0 0 localhost:60123 0.0.0.0:* LISTEN root 890899 189990/SevOne-datad

   tcp 0 0 localhost:60124 0.0.0.0:* LISTEN root 896321 191424/SevOne-ips-c

   tcp 0 0 localhost:60126 0.0.0.0:* LISTEN root 898164 191872/SevOne-ocd

   tcp 0 0 0.0.0.0:snmp 0.0.0.0:* LISTEN root 913422 194796/snmpd

   tcp 0 0 localhos:xmltec-xmlmail 0.0.0.0:* LISTEN prometheus 905473 193521/pushgateway

   tcp 0 0 localhost:smux 0.0.0.0:* LISTEN root 913425 194796/snmpd

   tcp 0 0 localhost:9095 0.0.0.0:* LISTEN root 897640 191872/SevOne-ocd

   tcp 0 0 localhost:cslistener 0.0.0.0:* LISTEN root 927427 197405/php-fpm: mas

   tcp 0 0 localhost:discp-client 0.0.0.0:* LISTEN quagga 931752 198339/zebra

   tcp 0 0 localhost:ircu-2 0.0.0.0:* LISTEN ingestion 895678 191375/SevOne-inges

   tcp 0 0 localhost:redis 0.0.0.0:* LISTEN redis 904778 193510/redis-server

   tcp 0 0 localhost:jetdirect 0.0.0.0:* LISTEN prometheus 905217 193398/node_exporte

   tcp 0 0 localhost:nsc-posa 0.0.0.0:* LISTEN quagga 932576 198341/bgpd

   tcp 0 0 0.0.0.0:sunrpc 0.0.0.0:* LISTEN root 15313 1/systemd

   tcp 0 0 0.0.0.0:http 0.0.0.0:* LISTEN root 909602 194384/nginx: maste

   tcp 0 0 localhost:sgi-esphttp 0.0.0.0:* LISTEN root 564775 75973/soa

   tcp 0 0 localhos:personal-agent 0.0.0.0:* LISTEN root 564779 75973/soa

   tcp6 0 0 [::]:33717 [::]:* LISTEN kafka 922030 196146/java

   tcp6 0 0 [::]:ssh [::]:* LISTEN root 515539 70512/sshd

   tcp6 0 0 [::]:https [::]:* LISTEN root 909605 194384/nginx: maste

   tcp6 0 0 [::]:8123 [::]:* LISTEN root 31856 1592/(squid-1)

   tcp6 0 0 [::]:snmp [::]:* LISTEN root 913423 194796/snmpd

   tcp6 0 0 [::]:XmlIpcRegSvc [::]:* LISTEN kafka 928765 196146/java

   tcp6 0 0 localhost:eforward [::]:* LISTEN kafka 921865 195873/java

   tcp6 0 0 [::]:60007 [::]:* LISTEN root 899670 192260/SevOne-reque

   tcp6 0 0 [::]:mysql [::]:* LISTEN mysql 315413 34172/mysqld

   tcp6 0 0 [::]:opsession-prxy [::]:* LISTEN mysql 314375 33715/mysqld

   tcp6 0 0 [::]:sunrpc [::]:* LISTEN root 15315 1/systemd

   tcp6 0 0 [::]:webcache [::]:* LISTEN restapi 951715 194898/java

   tcp6 0 0 [::]:http [::]:* LISTEN root 909603 194384/nginx: maste

   tcp6 0 0 [::]:11347 [::]:* LISTEN kafka 921342 195873/java

   udp 0 0 0.0.0.0:52518 0.0.0.0:* squid 31855 1592/(squid-1)

   udp 0 0 localhost:40676 0.0.0.0:* root 913414 194796/snmpd

   udp 0 0 0.0.0.0:bootpc 0.0.0.0:* root 26792 1356/dhclient

   udp 0 0 0.0.0.0:sunrpc 0.0.0.0:* root 15314 1/systemd

   udp 0 0 0.0.0.0:ntp 0.0.0.0:* root 25007 1215/chronyd

   udp 2176 0 0.0.0.0:snmp 0.0.0.0:* root 913415 194796/snmpd

   udp 0 0 0.0.0.0:snmptrap 0.0.0.0:* root 902773 193126/SevOne-trapd

   udp 0 0 localhost:323 0.0.0.0:* root 25005 1215/chronyd

   udp 0 0 localhost:syslog 0.0.0.0:* root 912596 194713/syslog-ng

   udp 0 0 0.0.0.0:17860 0.0.0.0:* root 902769 193126/SevOne-trapd

   udp 0 0 0.0.0.0:palace-5 0.0.0.0:* root 898156 191805/SevOne-netfl

   udp6 0 0 [::]:sflow [::]:* root 916463 195266/sflowtool

   udp6 0 0 [::]:sunrpc [::]:* root 15316 1/systemd

   udp6 0 0 [::]:ntp [::]:* root 25017 1215/chronyd

   udp6 0 0 [::]:snmp [::]:* root 913421 194796/snmpd

   udp6 0 0 [::]:snmptrap [::]:* root 902774 193126/SevOne-trapd

   udp6 0 0 localhost:323 [::]:* root 25006 1215/chronyd

   udp6 0 0 [::]:50222 [::]:* squid 31854 1592/(squid-1)

   udp6 0 0 [::]:13640 [::]:* restapi 915760 194898/java

   udp6 0 0 [::]:palace-5 [::]:* root 898157 191805/SevOne-netfl

   udp6 0 0 [::]:38979 [::]:* restapi 915759 194898/java

5. Execute the following command to add a custom port to the firewall. Replace <portNumber> with the number of the port you want to add. Replace <connectionType> with tcp or udp.

   $ firewall-cmd --zone=public --add-port=<portNumber>/<connectionType> --permanent

6. Execute the following command to reload the firewall and apply changes.

   $ firewall-cmd --reload

7. Exit the session when you are done.

Shut Down and Reboot SevOne NMS

SevOne NMS can run for extended periods of time. Occasionally it is necessary to shutdown or reboot an appliance. SevOne NMS stores data in cache and writes to the disk on a regular basis. The following shell commands back up the memory ring tables to the database on the disk to ensure that you do not lose data.

To shutdown SevOne NMS.

To reboot SevOne NMS.

Appendix - Obtain/Create Boot Media

In order to perform a build / rebuild installation, you must first have bootable media with the correct NMS recovery installation files.

If your NMS hardware shipped during or since August 2016, it should have included an inserted SD card for this purpose. If this is the case, and if you have not upgraded to a more recent version of NMS, you can skip the rest of this appendix and start the Installation Steps using that SD card as your bootable media.

Otherwise, you must download a recovery installation ISO and use it to build boot media.

1. Contact SevOne Support and request a download link.

2. When you receive your download link, click it and download the ISO file. (NOTE: Download links expire and must be used within 24 hours of sending.)

3. Create bootable media from this ISO. (Please see the grid below for instructions by media type and OS)

sevoneuser@mac$ sudo dd if=    
RHEL_NMS_v<6.x.y version>.iso    
 of=/dev/disk1 bs=2m
421+1 records in
421+1 records out
883949568 bytes transferred in 781.193450 secs 
(1131537 bytes/sec)

sevoneuser@mac$ sudo dd if=    
RHEL_NMS_v<6.x.y version>.iso    
 of=/dev/rdisk1 bs=2m
421+1 records in
421+1 records out
883949568 bytes transferred in 144.064811 secs 
(6135777 bytes/sec)