Openstack Cinder uses NetApp NFS as back-end storage

The company uses NetApp FS8020 R6 as a test environment for NFS storage. There's a chance to measure OpenStack's cinder and NetApp storage integration.

Description

1.OpenStack using NetApp Storage to mount NFS files directly without any problems, production has been using a more stable test iops in 160-220m/s.

2. Cinder with OpenStack cannot be used directly like a Linux host shared NFS file, requires a call to NetApp APIs to function, and if set to a standard drive phenomenon, Cinder-volume is normal at the beginning, But normally, after 10 minutes, the state is down. (Temporarily none)

The configuration file is as follows:

[DEFAULT]
Enabled_backends = NFS

[NFS]

Volume_backend_name = NFS//Yellow The naming of the three places should be unified, the naming content is not related to the use of protocols named Netapp_nfs
Volume_driver = cinder.volume.drivers.nfs.NfsDriver//define the type of drive used, universal NFS uses this option, and third-party vendor calls have different drive configurations
Nfs_sparsed_volumes = True
Nfs_shares_config =/etc/cinder/nfs_shares
Nfs_mount_point_base = $state _path/mnt
Nfs_mount_options = V3

[Email protected] cinder]# vim nfs_shares

172.16.5.242:/vol/sqmgtvm02/nfs//netapp Store ip:/shared file directory The correct content should be 172.16.5.242:/vol/ SQMGTVM02 provides volume not a folder for NFS but to isolate other files in production to increase NFS (resulting in error 2 below)

Check the error log in/var/log/cinder/volume.log as follows:

2017-09-07 22:07:58.983 16612 Error Oslo_service.service [req-37e3e47a-e1cb-47b8-a950-73374fd8713b-----] Error Starti ng thread.
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service Traceback (most recent call last):
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service File "/usr/lib/python2.7/site-packages/oslo_service/ service.py ", line 708, in Run_service
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service Service.start ()
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service File "/usr/lib/python2.7/site-packages/cinder/service.py", Line 234, in start
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service self.manager.init_host (added_to_cluster=self.added_to_ Cluster
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service File "/usr/lib/python2.7/site-packages/cinder/volume/ manager.py ", line 425, in Init_host
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service self.driver.init_capabilities ()
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service File "/usr/lib/python2.7/site-packages/cinder/volume/ driver.py ", line 704, in Init_capabilities
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service stats = self.get_volume_stats (True)
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service File "/usr/lib/python2.7/site-packages/cinder/volume/ drivers/remotefs.py ", line +, in Get_volume_stats
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service self._update_volume_stats ()
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service File "/usr/lib/python2.7/site-packages/cinder/volume/ drivers/nfs.py ", line 448, in _update_volume_stats
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service provisioned_capacity = self._get_provisioned_capacity ()
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service File "/usr/lib/python2.7/site-packages/cinder/volume/ drivers/remotefs.py ", line 212, in _get_provisioned_capacity
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service run_as_root=true)
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service File "/usr/lib/python2.7/site-packages/cinder/utils.py", Line 123, in Execute
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service return Processutils.execute (*cmd, **kwargs)
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service File "/usr/lib/python2.7/site-packages/oslo_concurrency/ processutils.py ", line 389, in Execute
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service cmd=sanitized_cmd)
2017-09-07 22:07:58.983 16612 Error Oslo_service.service processexecutionerror:unexpected error while running command.
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service command:sudo cinder-rootwrap/etc/cinder/rootwrap.conf du-- Bytes/var/lib/cinder/mnt/3d59744e62f876bf5171140e3a723d34
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service Exit code:1
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service stdout:u ' 4096\t/var/lib/cinder/mnt/ 3d59744e62f876bf5171140e3a723d34/.snapshot\n8268\t/var/lib/cinder/mnt/3d59744e62f876bf5171140e3a723d34\n '
2017-09-07 22:07:58.983 16612 ERROR oslo_service.service Stderr: '/bin/du:warning:circular directory Structure.\nthis A Lmost certainly means. A corrupted file system.\nnotify YOUR system manager.\nthe following directory is part of the cycle:\n \xe2\x80\x98/var/lib/cinder/mnt/3d59744e62f876bf5171140e3a723d34/.snapshot/sv_nightly.0\xe2\x80\ X99\n\n '

2017-09-09 21:33:28.066 154678 WARNING oslo_reports.guru_meditation_report [-] guru meditation now registers SIGUSR1 and S IGUSR2 by default for backward compatibility. SIGUSR1 'll no longer be registered in a future release, so please use SIGUSR2 to generate reports.
2017-09-09 21:33:28.500 154678 WARNING cinder.keymgr.conf_key_mgr [req-ba7d370f-a96c-4b3f-95fa-c6234277766e-----] Th Is key Manager is insecure and are not recommended for production deployments
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume [req-ba7d370f-a96c-4b3f-95fa-c6234277766e-----] volume service [Email protected] failed to start.
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume Traceback (most recent call last):
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume File "/usr/lib/python2.7/site-packages/cinder/cmd/volume.py", Line, in main
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume cluster=cluster)
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume File "/usr/lib/python2.7/site-packages/cinder/service.py", Line 382, in Create
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume cluster=cluster)
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume File "/usr/lib/python2.7/site-packages/cinder/service.py", Line 202, in __init__
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume *args, **kwargs)
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume File "/usr/lib/python2.7/site-packages/cinder/volume/ manager.py ", line 242, in __init__
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume active_backend_id=curr_active_backend_id)
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume File "/usr/lib/python2.7/site-packages/oslo_utils/ importutils.py ", line., in Import_object
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume return Import_class (IMPORT_STR) (*args, **kwargs)
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/ netapp/common.py ", line page, in __new__
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume na_utils.check_flags (netappdriver.required_flags, config)
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/ netapp/utils.py ", line +, in Check_flags
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume raise exception. Invalidinput (REASON=MSG)
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume invalidinput:invalid input received:configuration value netapp_s Torage_protocol is not set.
2017-09-09 21:33:28.513 154678 ERROR cinder.cmd.volume
2017-09-09 21:33:28.517 154678 ERROR cinder.cmd.volume [req-ba7d370f-a96c-4b3f-95fa-c6234277766e-----] No volume serv Ice (s) started successfully, terminating.
2017-09-09 21:33:30.401 154691 WARNING oslo_reports.guru_meditation_report [-] guru meditation now registers SIGUSR1 and S IGUSR2 by default for backward compatibility. SIGUSR1 'll no longer be registered in a future release, so please use SIGUSR2 to generate reports.
2017-09-09 21:33:33.308 154691 WARNING cinder.keymgr.conf_key_mgr [Req-44d8acf3-246c-4efb-aaaf-00d092a68f40-----] Th Is key Manager is insecure and are not recommended for production deployments

Correct configuration file:

[Netapp_nfs]
Volume_backend_name = Netpp_nfs
Volume_driver = Cinder.volume.drivers.Netapp.common.Netappdriver
netapp_storage_family = Ontap_7mode//netapp The current product line is divided into two modes
Netapp_storage_protocol = NFS//Usage protocol
Netapp_server_hostname = sqmgtvm02//change name recommended modify/etc/hosts to define host and IP (original IP address of 172.16.x.x using shared directory prompt authentication error changed to NetApp admin address OK)
Netapp_server_port = 80
Netapp_transport_type = HTTP//authentication protocol Select Support HTTPS and HTTP, standard I use HTTP mode. (HTTPS configuration is more complex see the following reference link)
Netapp_login = root//login user name, should be administrator rights, that is, login Onecommand the account and password
Netapp_password = netappxxx//Login Password
#netapp_vserver = svm_name//Specific unknown according to official documentation it should be sqmgtvm02.
Nfs_shares_config =/etc/cinder/nfs_shares//configure NetApp NFS Storage share content, you can use SHOWMOUNT-E 172.16.5.xxx to display a directory of storage shares
Nfs_mount_point_base = $state _path/mnt//mount to local mount point, change command to mount directly to/VAR/LIB/CINDER/MNT/6FF41DA189E9CE5BFC54AF3394ADBCD8
#max_over_subscription_ratio = 1.0//presumably disk over-ratio
#reserved_percentage = 5//volume reserved space ratio to prevent the volume from completely hanging up, there are similar options in Ceph to avoid space explosion you can perform an emergency delete or migration operation by freeing up space

Openstack Cinder uses NetApp NFS as back-end storage